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We establish the fluctuation theorem in the presence ol information exchange between a nonequi- 
librium system and other degrees of freedom such as an observer and a feedback controller, where 
the amount of information exchange is added to the entropy production. The resulting generalized 
second law sets the fundamental limit of energy dissipation and energy cost during the information 
exchange. Our results apply not only to feedback-controlled processes but also to a much broader 
class of information exchanges, and provides a unified framework of nonequilibrium thermodynamics 
of measurement and feedback control. 
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Introduction. Thermodynamics of information pro- 
cessing has attracted great interest ever since Maxwell's 
seminal work [1-9]. A number of researchers have dis- 
cussed various aspects on the relationship between in- 
formation and thermodynamics [lOt - 4591 ] - Such a field of 
research might be called "information thermodynamics." 
Recently, information processing at the level of thermal 
fluctuations has been experimentally realized in small 
thermodynamic systems such as colloidal particles (sol — 
Ifjil ] . Energetic and entropic costs of information process- 
ing are vital for designing and controlling nanomachines 
and nanodevices in thermally fluctuating environments. 

A key concept in information thermodynamics is a cor- 
relation between two subsyste ms, which is characterized 
by the mutual information [63l [r34 ] . If the subsystems are 
statistically independent, the mutual information van- 
ishes and the entropy is additive, i.e., the Shannon en- 
tropy of the total system is given by the sum of those of 
the subsystems. In the thermodynamic limit, a correla- 
tion between two subsystems is negligible, and therefore 
the mutual information vanishes to the leading order. 
This is the reason why the entropy is additive in con- 
ventional thermodynamics. In contrast, in small ther- 
modynamic systems, the mutual information can take 
a positive value and serves as a resource of the work or 
the free energy through feedback control, as illustrated in 
Maxwell's gedankenexperiment [l[ . The entropy of a sys- 
tem can be decreased without any heat dissipation if we 
use the correlation as a resource of the entropy decrease, 
although, in the conventional thermodynamics, the en- 
tropy of the system is decreased only in the presence of 
heat dissipation. 

Before developing a general theory, let us consider the 
Szilard engine [2j to elucidate the physical meaning of 
the correlation. A single-particle gas is enclosed in a box 
that is in contact with a heat bath at inverse tempera- 
ture /3. We consider cyclic processes in which the initial 



and final states of the gas are in thermal equilibrium with 
the same volume of the box. If we do not know the posi- 
tion of the particle, we cannot extract a positive amount 
of work from the gas because of the second law of ther- 
modynamics (i.e., the Kelvin principle). However, if we 
have one bit (= In 2 nat in the natural logarithm) of in- 
formation about the initial position of the particle, we 
can extract In 2 of work by means of feedback con- 
trol. To obtain the information, we insert a barrier at the 
center of the box, and measure whether the particle is in 
the left or right side (see also Fig. 1). The measurement 
outcome is recorded in a memory device. Here, the "in- 
formation" means the correlation between the position of 
the gas and the memory, which is described by In 2 of the 
mutual information. It is then used as a resource of the 
work through an isothermal expansion of the left or the 
right box. 



Szilard engine Memory 




FIG. 1: (color online). The Szilard engine and memory which 
are initially correlated with one bit (= In 2 nat) of the mu- 
tual information. We can then use this information to extract 
/3 _1 ln2 of work by means of feedback control. Here the in- 
formation is used for deciding in which direction we perform 
an isothermal expansion. 

The Szilard engine is restricted to the special setup 
with two boxes. How should fundamental laws of ther- 
modynamics be modified in the presence of a more gen- 
eral correlation between the system and other degrees of 
freedom? This question involves a broad class of informa- 
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tion processes of thermodynamic systems including the 
situations of measurement and feedback control. 

In this Letter, we generalize the fluctuation theorem 
(FT) [gi-lzl and the second law of thermodynamics (SL) 
by explicitly taking correlations into account, where the 
entropy production (EP) and the mutual information are 
treated on an equal footing. Our setup includes measure- 
ment and feedback control as important special cases, 
where they are treated in the same framework. As a 
corollary, we obtain a generalized FT that applies to mea- 
surement processes. In addition, our previous results, 
such as a generalized FT for feedback control [35[ and 
the minimal energy cost for measurement [lH , are repro- 
duced as special cases of our results. Our results are valid 
not only in Langevin systems but also far from equilib- 
rium situations of classical stochastic dynamics, because 
they can be derived on the basis of the detailed FT 66- 

Setup. Suppose that a classical stochastic system X is 
in contact with multi-heat baths labeled by k = 1, 2, • ■ • 
at inverse temperatures . System X may be driven to 
far from equilibrium by changing external parameters. 
We can extract work from X through such external pa- 
rameters. We assume that the time evolution of X is 
described by a classical stochastic dynamics from t = 
to t = t along trajectory Xp. Let x (x 1 ) be the initial 
(final) phase-space point of X, and P F [x] (P F [x'}) be 
the corresponding probability distribution. The EP in 
X and the baths is then given by 



(1) 



In PI 



is a change in 



where As := (-\nP F [x'}) - (- 
the stochastic entropy and Qk is the heat absorbed by 
the system from the fcth bath. We note that —fikQk is 
regarded as the entropy change in the fcth bath. 

In addition to the heat baths, system X interacts with 
another system Y . We assume that Y does not evolve 
in time during the interaction. This assumption applies 
not only to the standard setup of Maxwell's demon but 
also to a broader class of information processing. System 
X then evolves depending on the state y of Y (see also 
Fig. 2). The conditional probability of Xp being realized 
under the initial condition of x depends on y such that 
the conditional probability is given by Pp[Xp \x, y]. 

We also assume that x may be correlated with y in the 
initial and final states. Let P F [x,y] (P F [x',y]) be the 
initial (final) joint probability distribution of x (x') and 
y, where P F [x] = J dyP F [x,y] {P F [x'] = JdyP F [x',y}) 
and Pp[y] = J dxP F [x,y) = fdx'P F [x',y] are the 
corresponding marginal distributions. If P F [x,y] — 
P F [x] Pp [y] , x and y are statistically independent. Oth- 
erwise, they are correlated. We characterize the initial 
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FIG. 2: (color online). Interaction between X and Y. System 
X evolves from x to x' in such a manner that depends on the 
information about y, while y does not evolve in time. 



and final correlations between the two systems by 
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P F [x]P F [y] 



x'y 



hi 



PfW,y] 

P F [x'}P F [y}' 



(2) 



If x and y (x' and y) are not correlated, P xy (l£, y ) van- 
ishes. The ensemble averages of © ((P xy ) and (I x , y )) give 
the mutual information 63, |64j . We also refer to P xy and 
//,„ as the mutual information. Then, AI := l[, — J* 

x y x y xy 

gives the change in the mutual information during the 
dynamics. 

As discussed in detail later, this setup includes both 
cases of measurement and feedback control. In the case of 
measurement, (P xy ) = and (l[r y ) > hold, where (J^ y ) 
describes the obtained information. In contrast, in the 
case of feedback control, {P xy ) > 0, which is the resource 

of the work and the free energy, and (l£i y )(< (I xy )) is 
the remaining correlation after the feedback control. 

Main results. In the absence of the initial or final cor- 
relations, EP ([1]) satisfies the i nteg ral FT (or the Jarzyn- 
ski equality) (e _CT ) = 1 65|, 67, 69 |. where (■ • • ) describes 
the ensemble average over all microscopic trajectories. In 
contrast, in the presence of information processing with 
initial and final correlations, the integral FT is general- 
ized as 



-a+AI 



where we assume that 



p f[x, y] ^ for any (x, y). 



(3) 



(4) 



Equality ([3]) is the main result in this Letter, which will 
be proved later. By using the convexity of the exponen- 
tial function e< x > < (e x ), Eq. © leads to 



(a) > (AI). 



(5) 



Equality ([3]) and inequality ([S]) imply that we can control 
EP a in the subsystem by changing the correlation. In 
the absence of initial or final correlations, Eq. © and 
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inequality §Q reduce to the conventional FT and SL, re- 
spectively. Inequality ([5]) holds without assumption ((4]), 
while Eq. docs not, as shown later. 

In the presence of a single heat bath at inverse temper- 
ature /3, inequality ([5]) implies the minimal energy dissi- 
pation 



P(Q) > -<Aa) + (AJ) > 



(6) 



where —(Q) is the heat transfered from X to the bath. 
If (A/) = 0, inequality © reduces to -p{Q) > -(As), 
which leads to the celebrated Landauer principle and its 
generalizations 

H 0, EH-El- We note that (As) is a 
change in the total Shannon entropy. 

We next consider the energy cost for the informa- 
tion exchange with a single heat bath. Let E[x; t] be 
the Hamiltonian of X and Ei ni [x, y; t] be the interaction 
Hamiltonian between X and Y. We note that E and E int 
can be dependent explicitly on time t due to a change in 
external parameters. The first law of thermodynamics is 
given by 



AE + AE iDt = W + Q, 



(7) 



where AE := E[x':t] - E[x;0], AE int := E int [x', y; r] - 
E- ln t[x, y; 0], and W is the work performed on the system. 
From Eqs. (H)) and (JT]), we obtain 



(W) > AF cS + (AE int ) + p-^AI), 



(8) 



where F e g(t) := (E(t)) — (3 1 {s(t)) is an effective free 
energy of X 0, and AF off := F off (r) - F eff (0). We 
note that there is no thermodynamic restriction on the 
value of (A_E int ) as is the case for {AE). Inequality (|8]) 
shows that the correlation-induced energy cost (3^ 1 {AI) 
is added to the conventional bound in thermodynamics. 

A crucial point of our setup is that the entropy of 
X can be decreased without any heat flow. In conven- 
tional thermodynamics, (As) > P(Q), where the negative 
heat flow allows the entropy to decrease. In contrast, in 
our setup, (As) > (A/) if (Q) = 0, where the negative 
mutual-information change is the resource of the entropy 
decrease in X. Such an information-energy balance is 
based on the dynamics characterized by Fig. 2, where one 
of the two systems does not evolve in time. The general- 
ization of our results to more involved situations, where 
the two systems can influence each other and evolve in 
time, is an interesting future challenge. 

We now discuss important special cases: measurement 
and feedback control. 

Measurement. Let X be a measuring system (a de- 
mon) and Y a measured system (see Fig. 3 (a) for a 
special case). We assume that X is initially not cor- 
related with Y . Then, X performs a measurement on 
the value of y. In the final state, / := l£, character- 
izes the information gain by X that is positive because 
of (AI) = (I) > 0. In this case, Eq. ^ reduces to the 



generalized integral FT for the measurement process: 

(e- CT+/ ) = I- (9) 

Consequently, inequality (O reduces to (a) > (I), which 
means that an additional EP is accompanied by the mea- 
surement. Our result is consistent with Bennett's obser- 
vation that the energy dissipation can be zero during 
the measurement process with a single heat bath In 
fact, if both (As) and (/) equal the Shannon informa- 
tion obtained by the measurement, inequality (JB]) reduces 
to —(Q) > 0, which is the case that Bennett consid- 
ered. In general, the minimal heat dissipation is given by 
—0{Q) > —(As) + (/). The work needed for the mea- 
surement is bounded as (W) > AF cS + (AE int ) +/3~ 1 (I), 
where (I) describes an additional energy cost. A spe- 
cial case of this inequality was obtained in Ref. [23 1. 
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FIG. 3: (color online), (a) Position measurement on the Szi- 
lard engine (Y) by a memory system (X), where x describes 
the phase-space point of the memory, and y takes on or 
1 corresponding to "left" or "right." The initial correlation 
is (Ily) = and the final correlation is {l£,„) = In 2. (b) 
Feedback control on the Szilard engine (X) by a demon (Y), 
where x describes the position of the particle, and y (— or 
1) is the measurement outcome stored in the memory. The 
initial correlation is (P xy ) — In 2 and the final correlation is 



(I> ) 

\ x'y i 



0. 



Feedback control. Let X be a controlled system and 
Y a controller (a demon) (see Fig. 3 (b) for a special 
case). We assume that X is initially correlated with Y 
with mutual information I := F xy . By using this ini- 
tial correlation, Y performs feedback control on X in 
such a manner that the evolution of X depends on y. 
The correlation remaining after the feedback is given by 



j . = I f 

'rem ■— 1 x 'y 



In this case, Eq. ([3]) is equivalent to 



- CT -(/-/rem) 



) = h 



(10) 



which is the generalized integral FT for the feedback pro- 
cess. We note that a similar equality was obtained in 
Ref. [35|], which is equivalent to the present result with 
J rcm = 0. Corresponding to Eq. (fTOj) . inequality ([5]) re- 
duces to (<t) > — (/ — /rem), where (/ — / lcm ) > sets an 
upper bound of the correlation that is utilized by the de- 
mon. Correspondingly, the work that is extracted from a 
single heat bath by the demon, denoted as W cx t := —W, 
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is bounded as (W ext ) < -AF off - (A£; int )+/3- 1 (/-/ rcm ), 
where (/— / rcm ) describes the extractable work on top 
of the conventional bound. 

Derivation of the main result. We now derive Eq. ([3]) 
and several related relations. We first note that 
P F [X F ,y] = P F [X F \x,y]P F [x,y], where P F [X F ,y] is the 
joint probability distribution of realizing trajectory X F 
and y. We then introduce the backward processes, in 
which the control protocol of external parameters is time- 
reversed. For simplicity, we assume that the phase space 
of the system does not include momentum terms; the gen- 
eralization of our arguments to situations with momen- 
tum terms is straightforward. In considering the time- 
reversed trajectory, the initial probability distribution of 
the backward process is taken to be the final distribu- 
tion of the forward process. Let Xb be the time-reversed 
trajectory of X F . The joint probability distribution of 
(Xb, y) in the backward processes, denoted as Pb[Xb, y], 
is given by P B [X B ,y] = Pb[X b \x' ,y]P F [x' ,y], where 
Pp[x' , y] is the initial probability distribution of the back- 
ward processes and Pb [Xb \x' , y] is the conditional proba- 
bility of realizing Xb under the initial condition of (x', y). 

The detailed FT in our setup is given by 

P B [X B \x',y] 



P F [X F \x,y] 



(11) 



where we used the assumption that y does not evolve in 
time. We note that Eq. (fTTj) holds even when {AE int ) ^ 
0. We also note that detailed FT can be proved in the 
presence of multi-heat baths in several setups. For exam- 
ple, it has been proved under the assumptions that the 
total system including the heat baths obeys the Hamil- 
tonian dynamics and that the initial probability distri- 
butions of the baths are the canonical distributions [(iij . 
By noting that 

P B [X B ,y] _ P B [X B \x',y] P F W] P F [x',y]/P F [x'} 
P F [X Fl y] P F [X F \x,y] ' P F [x] ' P F [x, y]/P F [x] 

_P B [X B \x',y] P f F [x'\ P f F [x>,y] P F [x]P F [y] 



P F [X F \x,y] P F [x] P F [ x ']p F [ y ] P F [x,y] 



we obtain 



Pb[X b ,v] 



-a+AI 



(12) 



(13) 



P F [X F ,y] 

which is the detailed FT in the presence of information 
processing. We note that a — AI can be regarded as the 
total EP in the composite system XY and the baths, 
and therefore the total system satisfies the conventional 
FT. Equality f| 13[) implies the trade-off relation between 
the mutual-information change and EP in the subsystem. 

By using dX F — dX B , J dXsdyPB[XB,y] = 1, and 
assumption (j4|), we obtain 

P B [x B ,y] 



-a+AI\ 



which implies Eq. ([3]). Moreover, we obtain from Eq. (TIB"]) 
that 

(a-AI) = f P F [X F: y}\u PF[XF ' V \ dX F dy, (15) 



where the right-hand side is the relative entropy between 
the forward and backward probabilities. We note that 
Eq. (fTS"]) is a generalization of the result in Ref. [70| • In- 
equality ([5]) is also confirmed from Eq. (TT5")) because of 
the positivity of the relative entropy. The equality in ([5]) 
is achieved if P F [X Fl y] = P B [XB,y] holds for any X F 
and y. 

We discuss the case in which assumption ((4]) is not 
satisfied. Let S be a set of (x, y) such that P F [x,y] ^ 
holds for (x, y) £ S. We do not observe any event outside 
S, because it has the zero probability. We then obtain 



(e- a+AI ) 



Pb[X b ,v] 



>x, y )es PF[X F ,y] 

PB[XB,y}dX B dy, 



P F [X F ,y]dX F dy 



(16) 



P F [X Fl y] 



P F [X F ,y]dX F dy=l, (14) 



which is not necessarily unity. In other words, the left- 
hand side of Eq. (HJ) does not converge to unity in the 
limit of P F [x, y] — > +0 for (x, y) £ S. In contrast, the 
right-hand side of Eq. (|15[) converges in the same limit, 
and therefore Eq. (TT51 and inequality ([5]) still hold with- 
out assumption (j4)). 

Concluding remarks. We have addressed the question 
of correlations in thermodynamics by deriving the gen- 
eralized integral FT ((3]) and SL (0. The generalized SL 
leads to the minimal heat dissipation ([6]) and the minimal 
energy cost ([8]) for information exchanges. As corollaries, 
we have derived the generalized FT and SL for measure- 
ment and feedback-controlled processes in a single frame- 
work. Our results serve as guiding principles for designs 
of artificial nanomachines and nanodevices; for example, 
we can judge how efficient nanomachines with informa- 
tion processing can be, by comparing their entropy pro- 
ductions with the lower bounds of inequality ([S]). It is 
interesting to investigate a fluctuation theorem that only 
involves the variable of one of the systems that exchange 
information. Such a fluctuation theorem has been found 
only for feedback-controlled processes jUJ. Moreover, ex- 
perimental verifications of our results in small thermody- 
namic systems merits further study. 
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